arXiv:1503.03579vl [cs.DC] 12 Mar 2015 


A Study on Optimized Resource Provisioning in 

Federated Cloud 

Thiruselvan Subramanian* and Nickolas Savarimuthui 
Department of Computer Applications, 

National Institute of Technology, 

Tiruchirappalli - 620015, INDIA. 

Email; thirulic@gmail.com*, nickolas@nitt.edui 


Abstract —Cloud computing changed the way of computing as 
utility services offered through public network. Selecting multiple 
providers for various computational requirements improves 
performance and minimizes cost of cloud services than choosing 
a single cloud provider. Federated cloud improves scalability, 
cost minimization, performance maximization, collaboration 
with other providers, multi-site deployment for fault tolerance 
and recovery, reliability and less energy consumption. Both 
providers and consumers could benefit from federated cloud 
where providers serve the consumers by satisfying Service Level 
Agreement, minimizing overall management and infrastructure 
cost; consumers get best services with less deployment cost 
and high availability. Efficient provisioning of resources to 
consumers in federated cloud is a challenging task. In this 
paper, the benefits of utilizing services from federated cloud, 
architecture with various coupling levels, different optimized 
resource provisioning methods and challenges associated with it 
are discussed and a comparative study is carried out over these 
aspects. 
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I. Introduction 

In recent years cloud computing gained more popularity, as 
many prefer to host their applications in cloud due to factors 
such as reduced capital expenditures and operational overhead, 
increased IT responsiveness and efficiency, greater business 
flexibility through an on-demand, pay-as-you-go model that 
scales with business needs, more choice in providers and 
access to latest services available in the market. There are 
many cloud providers in the market such as Amazon EC2 
m . Microsoft Azure ||2l, GoGrid 13, Rack-space m offering 
everything as a service. laaS (Infrastructure as a Service) 
is one of the cloud service type wherein consumers would 
take computing infrastructure on lease from cloud providers. 
Cloud providers host, run and maintain the computational 
infrastructure, where they provide infrastructure to consumers 
as Virtual Machines (VMs). They are offered in different 
flavors as Virtual Instances (VI) based on configuration of 
resources such as CPU cycles, memory, network bandwidth 
and storage that are predefined by providers or customized 
according to consumer. To deploy their applications. Cloud 
consumers should load Virtual Machine Images (VMI) in VI, 
where VMI is composition of operating system along with 
required software packages to run the applications. Cloud 
consumer is responsible for maintaining the VMs which are 
loaded with operating system and application software. They 
are charged based on instance type, usage, data center location 


and pricing plan opted (Reservation plan or On demand 

plan)!!!, E), Q, 13. 

Selecting best resources from providers and allocating 
resource for their needs in large cloud market is a challenging 
task for consumer. A third party, cloud broker eases task of 
service selection from cloud providers and acts as intermediate 
between cloud consumer and cloud provider. They play an 
important role in getting the information from the cloud 
providers about services offered, price of the service, service 
availability etc., and selects the best resources according to 
the consumer requirements. They provide a uniform interface 
to access, manage, monitor and asses different cloud provider 
services irrespective of cloud providers technology. An evalu¬ 
ation against commercial clouds demonstrates that compared 
to single cloud deployment, multi-cloud deployment of VMs 
improves performance and reduces cost||9l. 

Cloud provider is considered to have infinite resources but 
there would always be an upper limit based upon restrictions 
on available hardware, network bandwidth, etc. When there are 
many infrastructure offerings provided by a Cloud provider, 
there arises a situation where the Cloud provider suffers 
resource exhaustion. Single cloud deployment model leads 
to several challenges where cloud service is unavailable to 
customer due to outages, natural disasters and attacks leaving 
customers with loss of access to services and data. These 
factors conclude that the usage of multiple clouds achieves 
better service, QoS and reliability. 

Resource provisioning in federated cloud is the process of 
finding optimal placement schemes for VMs and reconfigure 
them according to changes in the environment. Provisioning in 
federated cloud has several challenges due to lack of common 
standards and confusion prevails over which standardization 
methods has to be followed. Various resource provisioning 
challenges in federated clouds and the state of the art in 
optimized resource provisioning methods are discussed in 
chapter IV. Analysis over open issues are discussed in chapter 
V. 

II. Eederated Cloud 

Eederated cloud is a composition of two or more clouds 
that remain as distinct entities but are bound together by 
standardized or proprietary technology that enables data and 
application portability [Hoi. Eederated cloud opens the door 
to a range of useful scenarios that take advantage of cloud 
capabilities such as 


• Using multiple clouds for different applications to 
match consumer needs. 

• Utilizing public cloud when internal resources are not 
enough to meet demands. 

• Moving an application between public clouds or inter¬ 
nal data center to meet requirements at different stages 
in its life cycle. 

• Allocating different elements of an application to 
different environments, application stretching. 


A. Benefits 

Federated cloud brings out the following benefits over 
single cloud deployment. 

1) Scalability: As the demand scales up, cloud bursting 
addresses peak demand of consumers when they ran out of 
computing resources; they burst their workload to external 
cloud on demand basis and pay per use. Cloud providers col¬ 
laborate with other cloud providers to share their infrastructure 
with each other through contracts or framework agreements 
which defines control over resources. Quality of Service(QoS) 
rendered and availability, when there is demand for more 
resources. 

2 ) Multi-site Deployment: Allows infrastructure aggrega¬ 
tion across distributed data centers for availability of services; 
minimize data transfer cost by enabling service in data centers 
in non-peak hours; meet local jurisdiction and regulation on 
data placement within certain physical boundary. 

3) Reliability: Replication of service in multi-site deploy¬ 
ment enables fault tolerance with high availability of services 
such as data backup, natural disaster recovery and minimal 
downtime when a site fails. 

4) Performance and Cost: Deployment of services closer to 
end users increases the performance by reducing the data traffic 
and improves response time. Dynamic placement of applica¬ 
tions enables reduced overall deployment cost by deploying 
application in cloud provider, which offers service at minimal 
cost. Collaboration within cloud providers allows providers to 
scale up their services without spending high on infrastructure. 
Minimized energy consumption by server consolidation and 
placement of VMs in energy efficient data centers which in 
turn minimizes cost spend on energy. 


B. Coupling Levels 

Federated cloud exhibits various level of coupling between 
cloud instances such as level of cooperation among cloud 
instances, remote resource control, monitoring, security and 
access levels, possibility of cross-site networks and migrating 
VMs among cloud instances. Vozmediano et al. im discuss 
on federated cloud and explained more on coupling levels of 
cloud instances and federated cloud architectures. Coupling 
level of cloud instances in federated cloud environment are 
classified into three categories and are differentiated in Table 
I. 


1) Loosely Coupled Federation:: In this category, cloud 
instances have less inter-operation among themselves and is 
suitable for loosely coupled applications. Monitoring is limited 
and they can perform only basic operations on VMs such 
as start, stop and resume. Advance features such as cross¬ 
site networks and VMs migration between cloud sites and 
providers are not supported. 

2 ) Partially Coupled Federation: This consists of different 
cloud partners involved in contract or framework agreement 
with terms and conditions describing access methods for 
remote resources. The framework agreement enables certain 
level of control over remote resources, detailed monitoring and 
some advanced networking features among partner clouds. 

3) Tightly Coupled Federation: This category is usually 
formed by clouds belonging to the same organization, and 
normally governed by the same Cloud OS type. Cloud instance 
can have advanced control over remote resources, access to 
all the monitoring information of remote resources and can 
support features such as creation of cross- site networks, cross¬ 
site migration of VMs, implementation of high-availability 
techniques among remote cloud instances, creation of virtual 
storage systems across site boundaries. 

C. Federated Architectures 

Federated cloud has been implemented using different 
architectures with various coupling level of resources. Basic 
architectures of federated cloud lfTTl has been summarized in 
Table II. 

1) Cloud Bursting Architecture: When a cloud consumer 
ran out of computational resources from their own internal 
data-center or a private cloud, they bursts workload to cloud 
providers (Public Clouds) to meet their demand for which 
they will be charged on pay per use basis. If an organization 
has a VMware na based internal data center, CloudSwitch 
O allows the consumers to seamlessly move their workloads 
to public clouds such as Amazon EC2|[T1, Rackspace||4l,etc. 
CloudSwitch, utilizing their Cloud Isolation Technology, make 
the IP and MAC addresses of the public cloud appear as if they 
belong to an internal network. This allows the applications to 
run without any change, when moved to public clouds and 
the workload can be brought back into the internal data center 
whenever the consumer wishes. 

2 ) Cloud Broker Architecture: Integration and selection of 
cloud services from different cloud providers is too complex 
for cloud consumers to manage. Cloud consumers contact 
cloud broker for cloud services, instead of contacting cloud 
providers directly. Broker act as pairing service between cloud 
consumers and cloud providers. They negotiate contracts with 
cloud providers on behalf of the customer and distribute 
workloads across multiple cloud providers in an effort for cost 
effective deployment by hiding the complexity of negotiations. 
Customers are provided with an application program interface 
and unified management interface for utilizing cloud services 
from multiple cloud providers. Cloud broker architecture is 
loosely coupled with no advanced control over virtual re¬ 
sources of cloud providers. 

3) Aggregated Cloud Architecture: Cloud is believed to 
have infinite resources but there would always be an upper 


TABLE I. 


Coupling Level 


Coupling Level 

Control 

Monitoring and Accounting 

Cross-site 

Security 

Loosely Coupled 

Basic operations over VMs 

Basic virtual resource monitoring 

None 

Single account representing 
the organization 

Partial Coupled 

Advanced control over VMs, VMs 
location and affinity constraints 

Advanced virtual resource monitor¬ 
ing 

Virtual networks and storage 

Framework agreements 

Tightly Coupled 

Placement on specific resource, 
same VI type 

Physical resource consumption 

Live migration and high avail¬ 
ability 

User space sharing 


TABLE II. Federated Architecture 


Cloud Architecture 

Cloud Type 

Aim 

Coupling level 

Cloud Burst 

Private cloud to scale out with public or virtual private 
cloud resources 

Meet peak demands 

Loosely Coupled 

Cloud Broker 

User of several public clouds 

Cost, performance and reliability optimization 

Loosely Coupled 

Aggregated Cloud 

Aggregation of different private and public clouds 

Sharing of resources between partners to meet peak 
demands 

Partial Coupled 

Multi-Site Cloud 

Very large corporate clouds (private, public or virtual 
private) with several instances 

Scalability, isolation or multiple-site support 

Tightly Coupled 


limit based upon restrictions on available hardware, network 
bandwidth, etc. When there are many infrastructure offerings 
provided by a Cloud provider, there arises a situation where 
cloud provider end up in resource exhaustion. Under such 
situation a single cloud provider by itself, may not be able 
to fulfill additional infrastructure requirements of user in peak 
demands. Aggregated cloud architecture contributes beneath 
the layers to fulfill the infrastructure requirements of customers 
seamlessly. Cloud providers inter-operate and aggregate their 
resources based on contracts or framework agreements to 
provide their users with a larger virtual infrastructure. The 
customers would be aware of only the primary cloud provider. 
Through the primary cloud provider’s single virtual interface, 
the consumers must be able to add virtual infrastructure 
components and administer them as per their requirements. 
The actual action (addition, migration, etc.,) on infrastructure 
components in different clouds would be handled by cloud 
providers automatically. Cloud providers have advance control 
over cloud instance they utilize to meet demands as specified in 
the framework agreements between cloud providers ifTTI . iflTll . 
This architecture is partially coupled and RESERVOIR lfTSi is 
an example of aggregated cloud architecture. 

4) Multi-site Cloud Architecture: Multi-site cloud archi¬ 
tecture is implemented in organizations having geographically 
distributed cloud infrastructures or data center. They have full 
control over infrastructures and exposed as a single cloud to 
consumers. The cloud instances are tightly coupled and can 
perform cross-site networking and live migration of VMs. 

III. Resource Provisioning 

Resource provisioning in laaS cloud is the process of 
providing computational infrastructure (i.e. VI) to cloud con¬ 
sumers for their computational needs. Static resource provi¬ 
sioning based on peak demand is not cost-effective because 
of poor resource utilization during off-peak periods ifTbll . Au¬ 
tomatic resource provisioning would lead to efficient resource 
utilization since, additional resources are provisioned when de¬ 
mand increases and de-provisioned when demand is decreases. 

A. Resource Provisioning Challenges in Federated Cloud 

Integration of various clouds makes resource provisioning 
a challenging task. 


1) Application Architecture: Architecture of an applica¬ 
tion or a service has to be considered while provisioning 
of resources and constructing deployment plan in federated 
environment. Loosely coupled applications can be deployed 
in multiple clouds; constrains over selection of resources and 
deployment is minimal. Application components that are less 
independent, having more coordination and more information 
flow with other components (i.e. tightly coupled applications) 
should be deployed in single cloud or same physical server. 

2 ) Portability and Interoperability: In federated cloud ar¬ 
chitecture there should be ability to 

• Move data, applications, and VMs from one cloud 
computing environment to another. 

• Mix and match cloud services depending on business 
need. 

• Blend public and private cloud environments into 
hybrid cloud. 

• Develop and manage cloud services via industry stan¬ 
dard APIs. 

Portability is just not about avoiding vendor lock-in but 
considering factors such as performance, availability, QoS, 
scalability, budget and business agility. There are orchestration 
tools that can provide higher levels of abstraction for automat¬ 
ing portability between clouds without relying on a common 
cloud API, but there are common issues on portability and 
interoperability among cloud providers. They are 

• Integrating different services from one or more cloud 
service providers. 

• Managing security and business continuity risk across 
several cloud providers. 

• Managing life cycle of a service in a distributed 
multiple-provider environment in order to satisfy Ser¬ 
vice Level Agreement (SLA). 

• Maintaining effective governance and audit processes 
across integrated data centers and cloud providers. 

• Adopting or switching to a new cloud provider without 
QoS degradation. 




















Industry standards for portability and interoperability such as 
the Open Virtualization Format [DMT09] ifTTI and Cloud Data 
Management Interface [SNIlO] ifTsl are accepted and followed 
by many industry leaders in cloud. 

3) Deployment Plan: In federated cloud, cloud providers 
offer different services with different pricing models and 
service quality. Selection of best resources based on application 
requirements to minimize the budget of customer and maxi¬ 
mize the resource performance such as utilization, availability, 
reliability and minimum response time is a difficult task. 
Different models on optimized provisioning on resources based 
on cost and performance are discussed in Section 4. Due 
to uncertainty over demand from customer, availability of 
resources and price among providers, optimized deployment 
plan under uncertainty is challenging task ifTOll . Locality of data 
center determines speed of delivery, streaming and dynamic 
content to end users, and hence it is better to have data centers 
located near the end user. 

4) Quality of Service: QoS is one of the main features 
of cloud computing. To maintain the QoS, SLA plays an 
important role where, SLA is a part of service contract between 
cloud providers and consumers that define level of service in a 
formal way. In federated cloud computing environment, QoS 
is maintained during peak demands by provisioning resources 
from other clouds if resource is exhausted, recovery from 
failures by replicating consumer application in different clouds 
or data center across globe or transparently migrating services 
to other providers with less or no downtime. 

5 ) User Specific Constraints: The user can specify different 
constraints to deploy their applications that can restrict the 
deployment decisions. For example, hardware and platform 
constraints such as type of hypervisor, operating system, etc., 
affinity constraints such as two or more VMs that need to be 
deployed in the same physical server or in the same physical 
cluster, location constraints such as geographical restrictions 
on data center of provider where applications and data are 
to be deployed, or SLA constraints such as guaranteed CPU 
capacity, high operational reliability, etc im. 

6) Jurisdiction and Regulation: Cloud providers have to 
comply with international, federal or state directives such 
that data should reside within certain physical boundaries. 
So, customer can deploy their applications in different cloud 
providers who comply with regional laws to provide services 
for particular region ll20l . 

7) Resource Pricing and Instance Type: Pricing scheme of 
virtual resources varies among cloud providers. Amazon EC2 
offers three types of pricing plans Q namely Reserved, On De¬ 
mand and Spot Instances for provisioning VI. EIasticHosts|[6l 
allows users to customize instances and pricing based on 
instance resources such as CPU, memory, disk, SSD and data 
transferrate. In ElasticHosts and GoGridifSl, billing is based on 
hourly, monthly and yearly subscription. RackspacelH offers 
servers based on size of RAM and charge per hour usage. 
Most of cloud providers charge based on storage, memory 
and network bandwidth where long term subscriptions yields 
significant amount of saving to customers, but decision making 
on subscription is a challenging task. 


IV. Optimized Provisioning of Resources in 
Eederated Cloud 

Cloud providers faces the problem of finding an optimal 
solution for some criteria such as efficient utilization of 
existing resources by protecting QoS requirements of users 
and minimizing the overall budget of data centers. Cloud 
consumers aims at minimizing the cost of getting best service 
form providers. 


A. Cloud Bursting Architecture 

Bossche et al. ED proposes a method to minimize cost 
of external provisioning in which workloads are outsourced 
from an internal cloud to public cloud i.e. cloud bursting. 
Their work mainly deals with deadline-constraint and non 
migrative workloads, where memory, CPU, and networking are 
integrated in binary integer programming problem formation. 
They also provide some experimental insight into scalability 
and tractability of their formulations. Javadi et al. Il22l consider 
the problem of QoS-based resource provisioning in a hybrid 
cloud computing system where the private cloud is failure- 
prone and to overcome, hybrid cloud architecture is developed. 
They proposed brokering strategies in the hybrid cloud system 
where an organization that operates its private cloud aims to 
improve the QoS for the user’s requests by utilizing the public 
cloud resources and uses Knowledge-Pree Approach. 


B. Cloud Broker Architecture 

Chaisiri et al. E3i discuss on optimization of resource 
provisioning cost in federated cloud with future demand and 
price uncertainty. Authors consider reservation and on-demand 
pricing plan where focus is on minimizing on-demand and over 
subscription cost. Using Deterministic Equivalent Eormulation, 
Sample-Average Approximation, and Benders Decomposition 
methods for fast decision making. 

Tordsson et al. 0 discuss on the cloud brokering mech¬ 
anism that performs two operations (i) the optimal placement 
of the virtual resources of a virtual infrastructure across a set 
of cloud providers, and (ii) management and monitoring of 
these virtual resources by providing unified management user 
interface. By considering the demand and price of resources 
as static, they formed a 0-1 Integer Programming to minimize 
the cost and maximize the performance. Their experimental 
results confirm that multi-cloud deployment provides better 
performance and lower costs compared to the usage of a single 
cloud. 

Lucas-Simarro et al. Il24l present a cloud brokering archi¬ 
tecture that can work with different scheduling strategies for 
optimal deployment of virtual services across multiple clouds, 
based on different optimization criteria (e.g. cost optimization 
or performance optimization), different user constraints e.g. 
budget, performance, VI types, placement, reallocation or load 
balancing constraints and different environmental conditions 
i.e., static vs. dynamic conditions, VI prices, VI types, service 
workload, etc. Binary Integer programming formulation is 
used. 


TABLE III. 


Optimized Provisioning of Resources in Federated Cloud 


Author 

Architecture 

Optimization Criteria 

Decision Values 

Methodology 

Bossche et al. 1211 

Burst 

Cost 

Demand 

Binary Integer Programming 

Javadi et al. 1221 

Burst 

Performance and Cost 

Deadline , Performance, Cost and Failure of VMs 

Knowledge-Free Approach 

Chaisiri et al. 1231 

Broker 

Cost 

Dynamic demand and price of resource 

Stochastic Programming 

Tordsson et al. 

Broker 

Cost and Performance 

Static demand and Price of resource 

Binary Integer Programming 

Lucas-Simarro et al. 

M 

Broker 

Cost and Performance 

Budget and Performance 

Binary Integer Programming 

Breitgand et al. 1251 

Aggregated 

Profit, Performance and 
Energy Consumption 

QoS, Demand and Framework Agreements 

Integer Programming and Greedy LP Rounding 
heuristic 

Vecchiola et al. 1261 

Aggregated 

Performance 

Deadline, Performance and QoS 

Deadline-Driven Provisioning and Resource Pool¬ 
ing 

Wright et al. 1281 

Aggregated 

Cost and Performance 

User constraints such as Location, Budget and 
application resources 

Two-phase Constraints-based Discovery Approach 

Calheiros et al. 1291 

Aggregated 

Profit and Performance 

Performance, Reliability and Scalability 

Cloud Coordinator Architecture 


C. Aggregated Cloud Architecture 

Breitgand et al. ||25]| addresses the management challenge 
of efficient provisioning of elastic cloud services with a feder¬ 
ated approach. Their placement algorithm aims at maximizing 
providers profit while protecting QoS delivered to consumers. 
Integer Liner Programming formulations is used to optimize 
power saving and load balancing internally in a cloud, as 
well as to minimize the cost for outsourcing workloads to 
external partners and demonstrates the integration of place¬ 
ment algorithms with the RESERVOIR lITSl in federated cloud 
computing. 

Vecchiola et al. Il2^ implemented two algorithms in Aneka 
platform IZTl for (i)Deadline-driven provisioning and (ii) Re¬ 
source pool selection for deadline- driven provisioning of 
resource from multiple computing sources such as private 
cloud, public cloud, clusters, grids and desktop grids ,which is 
responsible for supporting QoS aware execution of scientific 
applications and efficiently allocate resources from different 
sources in order to reduce application execution times. 

Wright et al. Il28]l introduces a two-phase constraints-based 
approach to a multiple cloud provider environment for discov¬ 
ering the most appropriate infrastructure resources for a given 
application. In first phase, suitable resources are identified for 
the application and in second phase, heuristic approach based 
on cost and/or performance is used for selecting best resources 
from the identified resources. 

Calheiros et al. 1291 presents architecture of Cloud Coordi¬ 
nator element from InterCloud lfT9l architecture which repre¬ 
sents data centers and brokers in the InterCloud marketplace, 
and it is responsible for publishing offers and requests for 
resources, discovering potential providers of resources, and 
negotiating resources when it is necessary. 

V. Discussions 

Optimized resource provisioning methods are identified 
and are summarized in Table III. 

In cloud bursting, existing methods mainly focus on per¬ 
formance and cost for selecting public clouds while internal 
data center is exhausted. Customers should consider the het¬ 
erogeneous nature of public clouds, where provider specific 
adapter is needed to access resources from cloud by the 
internal data center. Existing cloud brokering approaches are 


not flexible enough to support all kinds of applications and 
QoS requirements. Application specific brokering has to be 
developed to identify application specific requirements and 
thus enhance brokering policies accordingly. 

Resource provisioning in loosely and partially coupled 
architectures have been widely studied and implemented fo¬ 
cusing mainly on constraints such as cost, performance and 
QoS. Resources provisioning polices have to be developed 
based on application architecture, user specific constraints, 
reliable deployment plan for fault tolerance and recovering 
from outages such as network failure, natural disaster, etc. 

VI. Conclusion 

In this paper, a study on optimized resource provisioning 
in federated cloud is made where, the basic architectures 
of federated cloud and the challenges associated with 
provisioning of resources are discussed. Einally, existing 
solutions on optimized provisioning of resources in federated 
cloud, by evaluating their deployment architectures are 
analyzed to give better perception. 

Issues identified for future work are summarized as follows. 

1) Customized SLA based on application requirements: 
Existing SLA approaches are not based on application re¬ 
quirements. Providers have set of SLAs, which mainly deals 
with the performance and availability of the service and not 
negotiable for application requirements. Application specific 
SLA has to be developed to meet customer requirements. 

2 ) Optimized Deployment Plan based on user constraints: 
Existing brokering mechanisms mainly deals with the op¬ 
timized selection of resources from multiple clouds based 
on cost and performance. Brokering mechanisms should deal 
with selection of resources based on application and user 
requirements such as location of data-center, reliability and 
QoS to meet uncertainty in demand, performance and cost of 
resources. 

3) Uniformity in pricing schemes and configuration of VI: 
Due to lack of standards in pricing and configuration of VI 
among cloud providers. It is difficult to choose optimized 
VI for application requirements and VM migration becomes 
tedious. Industry standards has to be developed to improve 
interoperability. 


















A flexible system satisfying both cloud consumer and 
provider could be achieved by fulfilling the above issues in 
future work. 
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